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Abstract 



' The Hoeffding-type-inequalities are obtained for the distribution tails of canonical 

CN ■ (degenerate) U- and ^-statistics of an arbitrary order based on samples from a 

bX), stationary sequence of observations satisfying p-mixing. 
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1. Introduction 



In the paper, we obtain some upper bounds for the distribution tails of U- and V-- 
statistics with canonical bounded kernels, based on samples of stationary observations 
under p-mixing. The exponential inequalities obtained are a natural generalization of the 
classical Hoeffding's inequality for the distribution tail of a sum of independent identically 
distributed bounded random variables. The approach of the present paper is well known: 
It is based on the kernel representation of the statistics under consideration as a multiple 
orthogonal series (for detail, see [5j QUI 15]). The results obtained in the present paper 
l/-) 1 improve the corresponding results in [6]. 

OS . Introduce basic definitions and notions. 

^ . Let Xi,X 2 , ... be a stationary sequence of random variables taking values in an ar- 

bitrary measurable space {X, A}, with a common distribution F. In addition to the 
stationary sequence introduced above, we need an auxiliary sequence {X*} consisting of 



independent copies of X\. 

Denote by L 2 (X m ,F m ) the space of measurable functions f(t±, . . . ,t m ) defined on 
the corresponding Cartesian power of the space {£, A} with the corresponding product- 
measure and satisfying the condition 

E/ 2 (X 1 *,...,X;)<oo. 

Definition 1. A function /(ii, . . . ,t m ) G L 2 (X m ,F rn ) is called canonical (or completely 
degenerate) if 

E/(ii, tfc_i, X k , t k+ i, t m ) = (1) 
for every k < m and all tj G X. 

Define a Von Mises statistic (or V- statistic) by the formula 

V n = V n (f) := n' m/2 f(.\ n V,.). (2) 

l<jl,— ,3m<n 

In the sequel, we consider only the statistics where the function f(ti, . . . , t m ) (the so-called 
kernel of the statistic) is canonical. In this case, the corresponding Von Mises statistic 
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is also called canonical. For independent {Xi}, such statistics are studied during last 
sixty years (see the reference and examples of such statistics in [TT]). In addition to V- 
statistics, the so-called [/-statistics were studied as well: 

U n ee U n (f):= n~ m ' 2 f(Xn,...,X im ). (3) 

Notice also that any [/-statistic is represented as a finite linear combination of canonical 
[/-statistics of orders from 1 to m. This representation is called Hoeff ding's decomposition 

(seem)- 

For independent observations {Xj}, we give below a brief review of results directly 
connected with the subject of the present paper. In this connection, we would like to 
mention the results in [3j Theorem 1], (2j Proposition 2.2], [TJ Theorem 7, Corollary 3], 
and [H Theorem 3.3]. 

One of the first papers where exponential inequalities for the distribution tails of U- 
statistics are obtained, is the article by W. Hoeffding [8] although he considered non- 
degenerated [/-statistics only. In this case, the value (n — m)\/n\ equivalent to n~ m as 
n — > oo, is used as the normalizing factor instead of rT m l 2 . The following statement was 
proved in [8]: 

F{U -EU>t)< e - 2fc * 2 /(^) 2 ; ( 4 ) 

where 

U=(n-m)\/n\ £ f(X n , . . . , X im ), 

l<ii^---^im<n 

a ^ f{tiy ■ ■ ■ jt m ) < b and k = [n/m]. In the case m = 1, inequality @ is usually called 
Hoeffding 's inequality for sums of independent identically distributed bounded random 
variables. Notice that, in this case, the sums mentioned may be simultaneously considered 
as canonical or nondegenerate [/-statistics. 

In [3], an improvement of (j4]) was obtained for the case when there exists a splitting 
majorant of the canonical kernel under consideration: 

i/(ti,...,t m )i < n^)> (5) 

and the function g(t) satisfies the condition 

%(^i) fe < o- 2 L k ~ 2 k\/2 
for all k > 2. In this case, the following analogue of Bernstein's inequality holds: 

nw„\> t )<c ie ^(- a2+ i tlMn _ l/2 y ( 6) 

where the constants c\ and c 2 depend only on m. Moreover, as noted in [3], inequality 
cannot be improved in a sense. 
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It is clear that if sup t . \f(ti, . . . , t m ) | = B < oo then, in (JS)), one can set a = L = B x l m . 
Then it suffices to consider only the deviation zone \t\ < Bn m ^ 2 in ([6]) (otherwise the left- 
hand side of (E]) vanishes). Therefore, for alH > 0, inequality (JEJ) yields the upper bound 

P(|K|>t)< Cl exp(-|(t/I?) 2 / m ) (7) 

which is an analogue of Hoeffding's inequality (J3J). 

In [2], an inequality close to (EJ) is proved without condition (JH]), and relation (J7J) is 
given as a consequence as well. In |7], some refinement of (J7J) is obtained for m = 2, and 
in [I], the later result was extended to canonical [/-statistics of an arbitrary order. 

The goal of the present paper is to extend inequality (J7|) to the case of stationary 
sequence of random variables {Xi} satisfying p-mixing. For dependent observations, we 
do not yet know how to get more precise inequalities close to Bernstein's inequality (JH]), 
for unbounded kernels under some moment restrictions only. 

2. The main results for dependent observations 

In the sequel, we assume that 3£ is a separable metric space equipped with the Borel 
cr-field A. Then the Hilbert space L 2 (£, .F) has a countable orthonormal basis {ej(t)}. 
Put eo(t) = 1. Using the Gram-Schmidt orthogonalization, one can construct an or- 
thonormal basis in L 2 (£, F) containing the constant function eo(t) = 1. Then Ee^-Xi) = 
for every i > 1 due to orthogonality of all the other basis elements to the function eo(t). 
The normalizing condition means that Ee?(Jfi) = 1 for all % > 1. It is well-known that 
the collection of functions 

{eii(*i)ei a (*2) • ■■e im (tm); k, ■ ■ ■ , i m = 0, 1, . . . } 

is an orthonormal basis of the Hilbert space L 2 (X m , F m ). The kernel f(ti, . . . , t m ) can be 
decomposed by the basis (e^^i) • • -ej m (t m )} and represented as the series 

oo 

f(h,...,t m )= /il.«.,<m e <l(*l) ,,,e <m(*m)> ( 8 ) 

il,...,j m = l 

which converges in the norm of L 2 (X m ,F m ) and the array {fi lt ...,i m } is square-summable 
at that. Note that the constant function eo(t) is absent in representation (JSJ) because 
the kernel is canonical ( for detail, see [5]). Moreover, if the coefficients {/i lr ..,i TO } 
are absolutely summable then, due to the B. Levi theorem and the simple estimate 
Ek^I*)-' e «m(^m)| — 1) the series in (JSJ) absolutely converges almost surely with 
respect to the distribution F m of the vector (X*, . . . ,X^ n ). In other words, if we sub- 
stitute the random vector (X*, . . . , X^) for (t 1 , . . . , t m ) in (JSJ) then the equality in (JSJ) is 
valid with probability 1 and the series absolutely converges with probability 1 as well. 

It is worth noting that, even under the above-mentioned conditions on the coefficient, 
we cannot extend the series representation in (JSJ) almost surely w.r.t. the distribution of 
the vector (Xi, . . . , X m ) with dependent coordinates (see [H], [6]). To extend the above rep- 
resentation to dependent observations we need some regularity conditions either on joint 
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distributions of the random variables (Xi, . . . , X m ) or on the kernel /(•) of the statistics 
under consideration (see Theorems 1 and 2 below). In particular, under the regularity 
conditions in Theorem 1, equality (JHJ) is satisfied everywhere. Then the corresponding 
Von Mises statistic (j2J) can be represented for all elementary events as follows: 

Vn = n m ' 2 Yl f(X !: V,J 

l<jl>— ,3m<n 



n -m/2 



5^ ^ f h ,...,i m e h (X jl )---e im (X jm ) 

l<ji>». ,jm<n ii,...,i m =l 



= £ /n,...,^ 1/2 E e -^)---^ 1/2 E e -^) 

il,...,im=l j = l j = l 

oo 

= fi l ,...,i m S n {i\) ■ ■ ■ S n (i m ), 

ii,...,i m =l 

where S n (ik) : = n -1 / 2 Y^=i e «fc(^i); & = 1, m - Note that this representation is a base 
to prove limit theorems for such statistics. 

In the present paper, we consider only stationary sequences {Xj} satisfying p-mixing 
condition. Recall the definition of this type of dependence. For j < k, denote by 9Jt^ the 
ex-field of all events generated by the random variables Xj, . . . ,X k , and by L 2 (9Jt^) the 
space of all 9Jt^-measurable random variables with finite second moments. 

Definition 2. A sequence X 1? X 2 , . . . satisfies p-mixing if 

PW SU P SU P — y °' 1 ~* 00 ' 

where we set 0/0 = by definition, and D is the variance operator. 

Recall that p-mixing coefficient is connected with the classical a- and <p-mixing coef- 
ficients by the following two-sided inequality (see [H]): 

4a(i) < p(i) < 2tp 1/2 (i). 

If {Xj} is a stationary Gaussian sequence (or an arbitrary bijection of stationary Gaussian 
observations) then (see [TO] ) 

4a (z) < p(z') < 2ira(i). 

Introduce some additional restrictions on the mixing coefficient and the kernels of the 
statistics under consideration: 



( A ) YZ,..,i m =i \fh,-,im\ < 00 and su Pi,t h(t)\ < C < oo. 

(B) p(k) < c e~ Clk , where c\ > 0, c > 1. 

If {Xj} is an arbitrary m-dependent stationary sequence then condition (B) is fulfilled. 
If {Xj} is a stationary Markov chain satisfying <p- or p-mixing then condition (B) is always 
fulfilled (see [14]). 

The main results of the present paper are contained in the following two theorems. 
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Theorem 1. Let a canonical kernel f(t±, . . . ,t m ) be continuous (in every argument) ev- 
erywhere on X m . Moreover, if ej.(t) are continuous and both conditions (A) and (B) are 
satisfied then the following inequality holds: 

H\V n \ > x) < exp { - C lX ^ m /B(f)}, (9) 

/ \ 2 / m 

where B(f) : = [C m Y^ i m =i \fh,...,i m \ ) an d C\ > depends only on cq and c\. 

Theorem 2. Let the sequence X 1 ,X 2 , . . . satisfy the following condition: 

(AC) For all pairwise distinct subscripts ji, . . . ,j m , the distribution of(Xj 1 , . . . , Xj m ) 
is absolutely continuous with respect to the distribution of (X*, . . . ,X^). 

Moreover, if both conditions (A) and (B) are fulfilled then 

W(\U n \ > x) < exp { - C lX 2 ' m /B(f)}, (10) 
where the constant C% is the same as in Theorem 1 . 

Remark. In [5] and [6], the reader can find some counterexamples which expose that 
continuity of the kernel in Theorem 1, condition (AC) in Theorem 2, and the requirement 
of absolutely summability of the coefficients in (A) cannot be omitted to derive the upper 
bounds for the distribution tails under consideration. 



3. Proof of the theorems 



Proof of Theorem 1 . Without loss of generality, we assume that the separable metric 
space X coincides with the support of the distribution F. The last means that X does 
not contain open balls with F-measure zero. Since all the basis elements Ck(t) in (jSJ) are 
continuous and uniformly bounded in t and k, due to Lebesgue's dominated convergence 
theorem, the series in (JS} is continuous if the coefficients ^ are absolutely summable. 
It is not difficult to see that, in this case, the equality in (JSJ) turns into the identity 
on the all variables t\, . . . ,t m because the equality of two continuous functions on an 
everywhere dense set implies their coincidence everywhere. So, in this case, one can 
substitute arbitrarily dependent observations for the nonrandom variables t\,...,t m in 
identity OH]). Therefore, for all elementary events, the above-mentioned representation 
holds: 

oo 

Vn(f)= fh,..,imSn(H)---S n (i m ), (11) 

il,...,i m =l 

where, as above, S n (i k ) := n' 1 / 2 Y!j=i e ik( X j)> k = 1, — 

The method of deriving the exponential inequalities for the tail probabilities is based 
on the following version of Chebyshev's inequality: 

E y2N 

n\Vn(f)\>x)< N M (12) 
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Notice that one can find this approach, for example, in [12], [3], and [TJ. 

So, consider an arbitrary even moment of the above-introduced V-statistic using rep- 
resentation ffTTT): 



EV n N = Yl /ii,..,i m ---/^- m+ i,...,i 2m iV E5 n(«l)---'S'n(W). (13) 



Further, we have 



where 



and 



■ ■ ■ S n (i 2mN )\ <n~ mN \^AX n )---e l2mN {X j2mN )\ 

h,—>hmN<n 

2mN 

= n- mN Y, E E l E ^---^l> (14) 

r=l fc!< - <fc r <n Sj(i):i<r,j<2mN 

2mN 

^ = 4f(X ki )---e^(X ki ), S ,(z)>0, E^'« >0 ' 



r 2mN 
8=1 J = l 

Notice that, for fixed r, the number of all collections of Sj(i) such that i runs from 1 to 
r and j runs from 1 to 2mN, coincides with the number of all different arrangements 
of 2mN indistinguishable elements in r cells when every cell must contain at least one 
element. It is well known that this value equals 

! _ (2mN-l)\ 



J 2mN-\ 



(2mN - r)!(r - 1)!' 



Lemma 1. // the sequence {Xi} satisfies p-mixing and restriction (A) is valid then, for 
every collection {ii, . . . ,i2miv}; the following inequality holds: 

\ES n (h) ■ ■ ■ S n (i 2mN )\ < (dC 2 mN) mN , 

where c depends only on the constants Cq and c\ . 

Proof. We will estimate every summand of the external sum over r in f[T4"|) (taking the 
normalizing factor n~ mN into account). The approach is quite analogous to that in the 
proof of the corresponding assertion in [H Lemma 4]. 

If r < mN then the number of all collections k\ < • • • < k r < n equals C r n and does 
not exceed n r < n mN . Hence, 



n - mN J- J2 \^ kl ---v kr \<C 2mN G 

fci<-</c r <n { Sj (i)} 
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Now, let r > mN . Fix an arbitrary collection of Sj(i) and consider the inner subsum 
in dHJ: 

Y l Et, fcn'"^J' ( 15 ) 

where t>i and t>2 are natural, with 1 < t>i < t>2 < r; here t> := t> 2 — f 1 + 1 is the multiplicity 
of the corresponding multiple subsum, and the blocks are defined as before. Denote 

V2 2mN 

Y Y s ^ = K ( v ^ v z)- 

i=v\ j = l 

Notice that, for v\ < I < v 2 , we have 

K(v 1 ,l) + K(l + l,v 2 ) = K(v 1 ,v 2 ). 
In the sequel, we will call v^. a short block if 



2mN 

E 



i. e., z/fc. = e^. (Xfc.) for some 1 < j ; < 2mN. Note that, in the case r > miV, there 
is at least one short block in the multiple subsum ( Tl5l) . We now prove the following 
statement: If the number of short blocks in the summands of subsum ( fl5l) is no less than 
d G {1, . . . , v } then the following estimate is valid: 

Y ■ • • ^ I < ^V^n""^^^, (16) 

where C2 may be chosen as 



c 2 = max{l6,16( T ^ r ) 4 , (^) 2 } 



Prove (TLB]) by induction on d for all fixed v\ and v 2 such that v < r. First, let d — 1, 
i. e., the moments in f fl5|) contain at least one short block. Denote it by 2^, where 
k vi < k[ < k V2 . In addition, denote 
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Then the following estimate holds: 



2 II 2 



< P(h+i-k)\\vk vl ---Vk l \\ 2 \\vk l+1 ---Vk, 

k vi <—<ki<n ki +1 <---<k V2 <n 



<n v ~ l C K{vi ' V2) Yp^ 



oo 
i=l 

+n ^-i C K(i + i,v 2) j2 pik-k^w^ ••■^_ 1 || 2 |K|| 2 

k vi < --<ki<n 
oo oo 

[ I 

i=l i=l 

ci 



< n^-iC^ 1 '^) ^p(i) + n V2 - l C K{l+1 ' V2) n l ~ Vl C K{vi > l) J2 P( 
i=i 

oo 

= 2n"- 1 C K(,;i ' ,,2) ^p(0 < 2 ^ 1 /2 C *(^ 2 )_^ 



-ci 

j=l 



The induction base is proved. 
Now, let the inequality 

hold for all the possible numbers z < d of the short blocks and all the multiplicities v, 
and the moments in (fT5|) contain no less than <i short blocks. Denote these blocks by 
i/jt^ , . . . , Vkj ■ Consider d — 1 pairs of neighbor blocks of the type Uk ja , Vk ja+1 , s < d — 1. 
Denote the differences between the subscripts in these pairs by ti, . . . ,td-i respectively. 
Among the summands in (!T5|) , select d — 1 classes (in general, intersecting) . We have 

Y ■■■v hv2 \<Ri + --- + Rd-i, 

<— <k Vo 

where the subsum R s is taken over the set of subscripts 

I s := {(k Vl , . . . , k V2 ) '. k vi < • • ■ < k V2 t s — maxtj j. 

We estimate every subsum R s as follows: 

Rs < J^pfe+l - kj.) \\v kvi ■ ■ ■ V k]s \\ 2 \\l>k js+1 ■ ■ ■ »K 2 II 2 
Is 

+ l E ^r--^J l E ^+i---^J- ( 17 ) 



8 



Consider the first sum in the right-hand side of (fTTj) . We have 
^p{k 3s+l - k js ) \\u kvi ■ ■ ■ l v kja || 2 |K s+1 ■ • • v K2 



"2 II 2 



< c K ^ V2)S ^ P {t s ) < c^K.^) n «-(d-i) p(t s ) 

I s tj .tj ^t.q 

n n 

< ^ ( ^ 2 V- d+1 ^p(£;)£; d - 2 < c K{vi ' V2) n v ~ d/2 ^ p(k)k d ' 2 - 1 

k=l k=l 

oo 

< C K(v 1 ,v 2 ) n v-d/2j2p(k)k d / 2 - 1 
=1 

/■oo 

/ e- Clt {t + l) d/2 - l dt 
Jo 



fc=i 

_r>oo 

£jK(v 1 ,v 2 ) n v-d/2 



C 



< < ^L C K{v l ,v 2 ) n v-d/2 T fd\ < 



OCpe 1 £, K (v u v 2 ) v-d/2jd/2-2 

(2ci) rf / 2 



The last inequality holds due to the evident fact that T(t) < 2t t ~ 2 . 

Now, consider the product of sums on the right-hand side of (fTTI) . Let the summands 
in the first of these sums contain d\ short blocks selected above. Correspondingly, in the 
summands of the second sum, there are d — di selected short blocks. By construction, 
we have 1 < d\ < d — 1, so, for both the sums, we can apply the induction assumption. 
Hence we have 

l Ez/ N " " " v *u I Yl l E *w-^j 

< c dl / 2 - 1 / 4 d dl/2 ~ 1 C K ( vl ' j3 ^n js ~ Vl+1 ~ dl/2 

x c {d ~ dl)/2 ~ 1/A (d - d 1 y d - di y 2 - i c K(js+1 ' v2) n v2 - js ~ {d - di)/2 

< c d / 2 ~ 1 / i ( ld/2-2 ( jK(v 1 ,V2) n v-d/2 

due to the evident inequality 

c~ Xl \d - d l f d - d ^ 2 ~ 1 df 12 - 1 < d d ' 2 - 2 . 
Combining the estimates for the two sums on the right-hand side of (TTT|) . we obtain 

R s < d d/2-2 C K(v u v 2 ) n v-d/2rd/2-l/2 + < ^2-1/^/2-2^(^)^/2 ^ 

(2ci) d > 2 

Summing all the upper bounds for R s , we conclude that 

]T \Eu kvi ■ ■ ■ v kv2 \<(d- i )c f -vv/ 2 - 2 c^^ V- d / 2 

< c d / 2 - 1 / 4 ^/2~l C K(v 1 ,v 2 ) n v-d/2 
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what required to be proved. 

Further, if r > mN then, in the summands in (I14p . there are no less than 2(r — mN) 
short blocks. Thus, setting in (JT6l) t>i := 1, t>2 '■= r, d := 2(r — mN), and u := r, we 
obtain the following estimate: 



n -mN 



fei<---<fc r <n (j) 

< 2 2mN - 1 c? N (2mN) mN - l C 2mN = 2 3mN - 2 c™ N C 2mN (mN) mN - 1 . 
Summing over all r from 1 to 2mN in (THI) . we conclude that 

|E^)---£„(^)| < (8c 2 ) miV C 2mJV (miV) miV . 

The lemma is proved. □ 

By this lemma, we estimate the even moment of the Von Mises statistic in ( TT3l) as 
follows: 

2N 

S/^<2_ AT\mN 



(00 
E - j 
H,...,i m =l 



Therefore, applying Chebyshev's inequality f lT2|) . we obtain the upper bound 

00 

P(|K|>a;)<*- 2 ^( E l/n,...,J^ m ) 2iV (^iVr^ 

ii,...,i m =l 

for any natural iV. Set iV = ax 2//m for some a > 0. (For simplicity, let iV be natural.} 
Then 

00 

n\v n \> x )<x-™( e i/u,..,j^ m ) 2JV (^«r^ 

ii,...,i m =l 

= exp {amlog(c4ma)x 2 / m } , 

where 

00 x 2/m 



C4 = C 



(00 \ z/m 

E /' < cm ) =~ cB U)- 
n,...,i m =i ' 



It is easy to verify that the multiplier am\og{c^ma) reaches its minimum at the point 
a = (c4me) _1 , and this minimal value equals — (c^e)' 1 . Then 

P(|K| > x) < exp { - (cB(f))- l x 2 ' m } 

what required to be proved. 

□ 
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Proof of Theorem 2. As noted above, the series in (jSj) converges almost surely with respect 
to the distribution of the vector (X*, . . . , X^) if the coefficients fi lt ...,i m are absolutely 
summable. It is clear that condition (AC) allows to claim the same for the distribution 
of the vector (X, 1; . . . , Xj m ) for every pairwise distinct subscripts ji, . . . ,j m . 

Since, in the summation set in the definition of [/-statistics, all the subscripts are 
pairwise distinct, we can substitute the series in (JSJ) for the kernel in expression fl3]). So 
we obtain the following representation: 



U n = n- m l 2 '• E e H (X n ) ■ ■ ■ e lm (X 



Jm ) 



Under condition (A), the proof repeats the previous one almost literally. Estimating the 
even moment of the statistic in the same way, we can obtain an upper bound for the 
multiple sum of mixed moments of the basis elements which appear as a result of raising 
the [/-statistic to the corresponding power. The difference between evaluations of the 
right-hand side of ( Fl3|) and this expression is as follows: Instead of the mixed moment on 
the right-hand side of (fTBl (Lemma 1) we should estimate the expectation 



n~ Nm E 



Jm > 



X 



mN — m+1 / ^2mN mN ) 



l<32mN-m+l¥ : ---¥ : j2mN <™ 

But the number of summands in the above multiple sum is less than that in the analogous 
multiple sum on the right-hand side of (JHJ) Thus the multiple sum in ( IT3|) is an upper 
bound for the above-mentioned mixed moment. Hence the expectation of normalized 
multiple sum above does not exceed the upper bound in (I14p . From here the statement 
of Theorem 2 immediately follows with the same constants as those in Theorem 1. 

□ 



References 

[1] ADAMCZAK, R. (2006). Moment inequalities for [/-statistics. Ann. Probab. 34 2288- 
2314. MR2294982. 

[2] ARCONES, M. A. and GINE, E. (1993). Limit theorems for [/-processes. Ann. 
Probab. 21 1494-1542. MR1235426. 

[3] BORISOV, I. S. (1991). Approximation of distributions of von Mises statistics with 
multidimensional kernels. Siberian Math. J. 32 554-566. MR1142066. 

[4] BORISOV, I. S. and BYSTROV, A. A. (2006). Limit theorems for the canonical von 
Mises statistics with dependent data. Siberian Math. J. 47 980-989. MR2302840. 



11 



[5] BORISOV, I. S. and VOLODKO, N. V. (2008). Orthogonal series and limit theorems 
for canonical U- and ^-statistics of stationary connected observations. Siberian Adv. 
Math. 18 244-259. MR2437480. 

[6] BORISOV, I. S. and VOLODKO, N. V. (2009). Limit theorems and exponential in- 
equalities for canonical U- and ^-statistics of dependent trials. High Dimensional 
Probability V, 108-130. Inst. Math. Stat. Collect. 5, Luminy, France. 

[7] GINE, E., LATALA, R. and ZINN, J. (2000). Exponential and moment inequalities for 
[/-statistics. High Dimensional Probability II, 13-38. Progr. Probab., 47, Birkhauser, 
Boston. MR1857312. 

[8] HOEFFDING, W. (1963). Probability inequalities for sums of bounded random vari- 
ables. J. Amer. Statist. Assoc. 58 13-30. MR144363. 

[9] IBRAGIMOV, I. A. and LINNIK, Yu. V. (1971). Independent and Stationary Se- 
quences of Random Variables. Wolters-Noordhoff Publishing Company, Groningen, 
The Netherlands. MR322926. 

[10] IBRAGIMOV, I. A. and ROZANOV, Yu. A. (1978). Guassian Random Processes. 
Applications of Mathematics, Springer- Verlag, New York-Berlin. MR543837. 

[11] KOROLYUK, V. S. and BOROVSKIKH, Yu. V. (1994). Theory of U-Statistics. Kluwer 
Academic PubL, Dordrecht. MR1472486. 

[12] MAJOR, P. (1981). Multiple Wiener-Ito Integrals. Lecture Notes in Math. 849. 
Springer, New York. MR611334. 

[13] PETROV, V. V. (1975). Sums of Independent Random Variables. Springer, New York. 
MR388499. 

[14] ROSENBLATT, M. (1971). Markov Processes. Structure and Asymptotic Behavior. 
Springer, Berlin. MR329037. 

[15] RUBIN, H. and VITALE, R. (1980). Asymptotic distribution of symmetric statistics. 
Ann. of Statis. 8 165-170. 



12 



